Usability of Telehealth Systems for Noncommunicable Diseases in Primary Care From the COVID-19 Pandemic Onward: Systematic Review.

BACKGROUND: During the COVID-19 pandemic, telehealth was expanded without the opportunity to extensively evaluate the adopted technology's usability. OBJECTIVE: We aimed to synthesize evidence on health professionals' perceptions regarding the usability of telehealth systems in the primary care of individuals with noncommunicable diseases (NCDs; hypertension and diabetes) from the COVID-19 pandemic onward. METHODS: A systematic review was performed of clinical trials, prospective cohort studies, retrospective observational studies, and studies that used qualitative data collection and analysis methods published in English, Spanish, and Portuguese from March 2020 onward. The databases queried were MEDLINE, Embase, BIREME, IEEE Xplore, BVS, Google Scholar, and grey literature. Studies involving health professionals who used telehealth systems in primary care and managed patients with NCDs from the COVID-19 pandemic onward were considered eligible. Titles, abstracts, and full texts were reviewed. Data were extracted to provide a narrative qualitative evidence synthesis of the included articles. The risk of bias and methodological quality of the included studies were analyzed. The primary outcome was the usability of telehealth systems, while the secondary outcomes were satisfaction and the contexts in which the telehealth system was used. RESULTS: We included 11 of 417 retrieved studies, which had data from 248 health care professionals. These health care professionals were mostly doctors and nurses with prior experience in telehealth in high- and middle-income countries. Overall, 9 studies (82%) were qualitative studies and 2 (18%) were quasiexperimental or multisite trial studies. Moreover, 7 studies (64%) addressed diabetes, 1 (9%) addressed diabetes and hypertension, and 3 (27%) addressed chronic diseases. Most studies used a survey to assess usability. With a moderate confidence level, we concluded that health professionals considered the usability of telehealth systems to be good and felt comfortable and satisfied. Patients felt satisfied using telehealth. The most important predictor for using digital health technologies was ease of use. The main barriers were technological challenges, connectivity issues, low computer literacy, inability to perform complete physical examination, and lack of training. Although the usability of telehealth systems was considered good, there is a need for research that investigates factors that may influence the perceptions of telehealth usability, such as differences between private and public services; differences in the level of experience of professionals, including professional experience and experience with digital tools; and differences in gender, age groups, occupations, and settings. CONCLUSIONS: The COVID-19 pandemic has generated incredible demand for virtual care. Professionals' favorable perceptions of the usability of telehealth indicate that it can facilitate access to quality care. Although there are still challenges to telehealth, more than infrastructure challenges, the most reported challenges were related to empowering people for digital health. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews CRD42021296887; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=296887. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.21801/ppcrj.2022.82.6.

Evaluating User Experience With a Chatbot Designed as a Public Health Response to the COVID-19 Pandemic in Brazil: Mixed Methods Study.

BACKGROUND: The potential of chatbots for screening and monitoring COVID-19 was envisioned since the outbreak of the disease. Chatbots can help disseminate up-to-date and trustworthy information, promote healthy social behavior, and support the provision of health care services safely and at scale. In this scenario and in view of its far-reaching postpandemic impact, it is important to evaluate user experience with this kind of application. OBJECTIVE: We aimed to evaluate the quality of user experience with a COVID-19 chatbot designed by a large telehealth service in Brazil, focusing on the usability of real users and the exploration of strengths and shortcomings of the chatbot, as revealed in reports by participants in simulated scenarios. METHODS: We examined a chatbot developed by a multidisciplinary team and used it as a component within the workflow of a local public health care service. The chatbot had 2 core functionalities: assisting web-based screening of COVID-19 symptom severity and providing evidence-based information to the population. From October 2020 to January 2021, we conducted a mixed methods approach and performed a 2-fold evaluation of user experience with our chatbot by following 2 methods: a posttask usability Likert-scale survey presented to all users after concluding their interaction with the bot and an interview with volunteer participants who engaged in a simulated interaction with the bot guided by the interviewer. RESULTS: Usability assessment with 63 users revealed very good scores for chatbot usefulness (4.57), likelihood of being recommended (4.48), ease of use (4.44), and user satisfaction (4.38). Interviews with 15 volunteers provided insights into the strengths and shortcomings of our bot. Comments on the positive aspects and problems reported by users were analyzed in terms of recurrent themes. We identified 6 positive aspects and 15 issues organized in 2 categories: usability of the chatbot and health support offered by it, the former referring to usability of the chatbot and how users can interact with it and the latter referring to the chatbot's goal in supporting people during the pandemic through the screening process and education to users through informative content. We found 6 themes accounting for what people liked most about our chatbot and why they found it useful-3 themes pertaining to the usability domain and 3 themes regarding health support. Our findings also identified 15 types of problems producing a negative impact on users-10 of them related to the usability of the chatbot and 5 related to the health support it provides. CONCLUSIONS: Our results indicate that users had an overall positive experience with the chatbot and found the health support relevant. Nonetheless, qualitative evaluation of the chatbot indicated challenges and directions to be pursued in improving not only our COVID-19 chatbot but also health chatbots in general.